Evaluation of a simulated vehicle-related feature

ABSTRACT

A method performed by a vehicle feature evaluation system (1) for enabling evaluation of a simulated vehicle-related feature. The vehicle feature evaluation system determines (1001) in relation to a road-driven vehicle (2), with support from a tracking system (5), an orientation of a head-mounted display (4), HMD, adapted to be worn by an occupant (3) on-board the road-driven vehicle. The vehicle feature evaluation system further determines (1002) a simulated vehicle design feature to be evaluated in the road-driven vehicle. Moreover, the vehicle feature evaluation system provides (1006) in real-time to a HMD display (41) of the HMD, taking into consideration the HMD orientation, a virtual representation (7) of the simulated vehicle design feature superimposed on a real-time surrounding-showing video stream (6) derived from real-world image data (211) captured with support from one or more vehicle-attached cameras (21) adapted to capture surroundings external of the road-driven vehicle.

CROSS-REFERENCE TO RELATED APPLICATION

The present disclosure claims the benefit of priority of co-pendingEuropean Patent Application No. 18210988.4, filed on Dec. 7, 2018, andentitled “EVALUATION OF A SIMULATED VEHICLE-RELATED FEATURE,” thecontents of which are incorporated in full by reference herein.

TECHNICAL FIELD

The present disclosure relates to enabling evaluation of a simulatedvehicle-related feature.

BACKGROUND

In the automotive field, when evaluating new vehicle functions,interaction designs, interaction models and/or new product designs, itis known to provide a virtually modelled evaluation environment. Staticor dynamic evaluation rigs are commonly utilized, where the static rigfor instance may be represented by a non-movable rig that may displaythe environment and traffic on large scale screens in front of a vehiclemock-up, and where the dynamic rig for instance may be represented by asimilar rig with the difference that the dynamic rig may move in orderto simulate acceleration forces and/or movement. A drawback for bothstatic and dynamic rigs is that the test subject may feel motionsickness. Yet another drawback is that the environment as well as thetraffic in fact is simulated. The latter results in that the interactiontherewith may become somewhat artificial, and it may be difficult tovalidate that the result actually corresponds to an experience in a realvehicle, in real traffic. Furthermore, for evaluation of a completevehicle—such as e.g. dimensions and/or designs thereof—it is commonlyknown in the art to build a physical mock-up. With this approach,however, it is not possible to drive and evaluate in an authentic and/orreal environment. Accordingly, there is room for improvement and/or foralternative solutions when it comes to evaluating a complete vehicle orat least a portion thereof with functions, interaction models and/ordesign(s) in order to verify and/or validate concepts.

SUMMARY

It is therefore an object of embodiments herein to provide an improvedand/or alternative approach supporting evaluation of virtual vehicledesigns and/or concepts.

According to a first aspect of embodiments herein, the object isachieved by a method performed by a vehicle feature evaluation systemfor enabling evaluation of a simulated vehicle-related feature. Thevehicle feature evaluation system determines in relation to aroad-driven vehicle, with support from a tracking system, an orientationof a head-mounted display, HMD, adapted to be worn by an occupanton-board the road-driven vehicle. The vehicle feature evaluation systemfurther determines a simulated vehicle design feature to be evaluated inthe road-driven vehicle. Moreover, the vehicle feature evaluation systemprovides in real-time to a HMD display of the HMD, taking intoconsideration the HMD orientation, a virtual representation of thesimulated vehicle design feature superimposed on a real-timesurrounding-showing video stream derived from real-world image datacaptured with support from one or more vehicle-attached cameras adaptedto capture surroundings external to the road-driven vehicle.

Thereby, there is introduced an approach which enables a virtual versionof a feature related to and/or associated with a vehicle to be evaluatedwithout a need to build a physical mock-up for evaluation. That is,since there is determined in relation to a road-driven vehicle, withsupport from a tracking system, an orientation of a head mounteddisplay, HMD, adapted to be worn by an occupant on-board the road-drivenvehicle, there is established a position and/or location of anoccupant-worn HMD in view of a real vehicle e.g. adapted to and/orintended to be driven outdoors such as in real traffic and/or alongactual roads. Thus, with the HMD-wearing occupant being positioned in aroad-driven vehicle rather than in an e.g. indoor static or dynamic rig,evaluation may take place in an actual real vehicle. Furthermore, thatis, since there is determined a simulated vehicle design feature to beevaluated in the road-driven vehicle, there is defined—e.g.computer-generated—a virtual vehicle design feature of interest tovalidate in a real vehicle. Moreover, that is, since there is providedin real-time to a HMD display of the HMD, taking into consideration theHMD orientation, a virtual representation of the simulated vehicledesign feature superimposed on a real-time surrounding-showing videostream derived from real-world image data captured with support from oneor more vehicle-attached cameras adapted to capture surroundingsexternal to the road-driven vehicle, there is provided to the HMDdisplay a real-time physical world view of surroundings external theroad-driven vehicle—essentially as captured by the vehicle-attachedcamera(s)—electronically mixed with the computer-generated virtualdesign feature representation temporally and spatially commensurate withsaid physical world view such that the surrounding-showing video streamappears as a background overlaid with said virtual design featurerepresentation. Thus, with the vehicle-attached camera(s) provided tocapture surroundings external of the road-driven vehicle, the real-timesurrounding-showing video stream shows surroundings and/or anenvironment exterior of the vehicle, hence excluding interior—andpotentially at least partial exterior—views of said road-driven vehicle.Subsequently, with the HMD-wearing occupant being on-board theroad-driven vehicle and with the HMD orientation being taken intoconsideration, provided to the HMD display is then a portion ofsurrounding-showing video stream corresponding to and/or spatiallycommensurate with a field of view of the HMD-wearing occupant. TheHMD-wearing occupant would accordingly be shown—on the HMD display(s)—aphysical world view spatially commensurate with said occupant's field ofview, but from which physical world view an interior—and potentially atleast a portion of an exterior—of the road-driven vehicle would beexcluded due to the vehicle-attached camera(s) capturing surroundingsexternal of—not internal of—the road-driven vehicle. Thus, the real-timesurrounding-showing video stream may then represent what a driver orpassenger of said road-driven vehicle would essentially see even if notwearing the HMD, but with interior—and potentially at least partialexterior—portions of the road-driven vehicle removed. Accordingly, withthe interior—and potentially at least a portion of the exterior—of theroad-driven vehicle essentially wiped out from the HMD-wearingoccupant's physical world view, one or more simulated designfeatures—e.g. represented by a simulated updated and/or new interior orexterior or a portion thereof—may be evaluated in its place. Thus, uponin real-time superimposing a virtual representation of a simulatedvehicle design feature—such as e.g. a complete interior and parts of anexterior or e.g. at least a simulated dashboard—on thesurrounding-showing video stream, said simulated vehicle design featuree.g. simulated dashboard may be evaluated in a road-driven vehicle, e.g.while said road-driven vehicle is driven in real traffic and/or alongactual roads. Thereby, with the exception of the virtual design featurerepresentation, the entire test environment is authentic and/or real.Consequently, the simulated vehicle design feature may be evaluated inreal traffic and/or in real road-driving scenarios, which thus enablessaid simulated vehicle design feature to be evaluated under morereality-resembling conditions and/or in a more reality-resemblingenvironment than should said evaluation be performed in e.g. a commonlyknown physical mock-up.

For that reason, an improved and/or alternative approach is providedsupporting evaluation of virtual vehicle designs and/or concepts. Thetechnical features and corresponding advantages of the above mentionedmethod will be discussed in further detail in the following.

By introducing a method performed by a vehicle feature evaluation systemfor enabling evaluation of a simulated vehicle-related feature, anapproach is provided which enables a virtual version of a featurerelated to and/or associated with a vehicle to be evaluated without aneed to build a physical mock-up for evaluation. The expression “vehiclefeature evaluation system” may refer to “vehicle feature validationsystem”, “vehicle evaluation system”, “evaluation system” and/or“evaluation supporting system”, whereas “for enabling evaluation of” mayrefer to “for evaluating” and/or “for providing”. Furthermore,“enabling” evaluation may refer to “supporting” evaluation, whereas“evaluation” may refer to “validation”, “testing” and/or “analysis”.“Simulated” vehicle-related feature, on the other hand, may refer to“virtual”, “computer-generated”, “modelled” and/or “fictive”vehicle-related feature, whereas “a simulated vehicle-related feature”may refer to “a simulated vehicle design feature”, “a simulated vehicledesign”, “a simulated vehicle concept”, “a simulated vehicle feature”and/or “simulated vehicle characteristics”. According to an example, theexpression “for enabling evaluation of a simulated vehicle-relatedfeature” may refer to “for enabling evaluation of a simulatedvehicle-related feature in a road-driven vehicle”.

Since the vehicle feature evaluation system determines in relation to aroad-driven vehicle, with support from a tracking system, an orientationof a head mounted display, HMD, adapted to be worn by an occupanton-board the road-driven vehicle, there is established a position and/orlocation of an occupant-worn HMD in view of a real vehicle e.g. adaptedto and/or intended to be driven outdoors such as in real traffic and/oralong actual roads. Thus, according to the introduced inventive conceptand as will be described in further detail further on, with theHMD-wearing occupant—which may also be referred to as the testsubject—being positioned in a road-driven vehicle rather than in an e.g.indoor static or dynamic rig, evaluation may take place in an actualreal vehicle. Determining the orientation of the HMD in relation to theroad-driven vehicle, with support from the tracking system, may beaccomplished as commonly known in the art, for instance with input fromtracking sensors such as cameras, accelerometers, magnetometers and/orgyroscopes, and/or based on software tracking e.g. aligning markers inthe vehicle with corresponding markers in the virtual model. The HMD, onthe other hand, may comprise and/or support any arbitrary features knownin the art from HMDs commonly utilized today, with the addition offurther features that will be described further on. The referred to“vehicle” may be represented by any arbitrary vehicle, for instance anengine-propelled vehicle, such as e.g. a car, truck, lorry, van, tractorand/or bus. The expression “road-driven vehicle”, on the other hand, mayrefer to “real vehicle”, “outdoor vehicle”, “vehicle adapted to bedriven in real traffic” and/or “vehicle adapted to be driven alongoutdoor tracks and/or public roads and/or public road networks”.“Determining” in relation to a road-driven vehicle may refer to“calculating and/or analysing” in relation to a road-driven vehicleand/or “determining optically, magnetically and/or by means of laser” inrelation to a road-driven vehicle. “In relation to” may refer to “inview of” and/or “in comparison to”. “In relation to a road-drivenvehicle” may further refer to “in relation to a reference point of aroad-driven vehicle”, which “reference point” may be arbitrarilyselected as deemed adequate for the implementation at hand. Theexpression “with support from” a tracking system may refer to “by meansof” a tracking system and/or “with input from” a tracking system,whereas “a tracking system”, on the other hand, may refer to “one ormore tracking sensors” and/or “a software based tracking system”. “Anorientation” of a head-mounted display may refer to “a position and/orlocation of” a head-mounted display, whereas “head-mounted display” mayrefer to “augmented reality and/or virtual reality head-mounteddisplay”, “goggles” and/or “electronic goggles”. The expression “adaptedto be worn by” an occupant may refer to “adapted to be worn at leastpartly in front of the eyes of” an occupant and/or merely “worn by” anoccupant, whereas “an occupant” may refer to “a vehicle occupant”, “adriver” and/or “a test subject”. “On-board” the road-driven vehicle mayrefer to “positioned in”, “seated in a front seat of” and/or “seated ina driver's seat of” the road-driven vehicle.

Since the vehicle feature evaluation system determines a simulatedvehicle design feature to be evaluated in the road-driven vehicle, thereis defined—e.g. computer-generated—a virtual vehicle design feature ofinterest to validate in a real vehicle. “Determining” a simulatedvehicle design feature may refer to “computer-generating”, “simulating”and/or “modelling” a simulated vehicle design feature, whereas vehicle“design feature” may refer to vehicle “characteristics” and further tomerely vehicle “feature” and/or vehicle “concept”. According to anexample, “determining” a simulated vehicle design feature may refer to“determining logic, design, graphics, aesthetics, geometries and/orfunctionality of” a simulated vehicle design feature.

Since the vehicle feature evaluation system provides in real-time to aHMD display of the HMD, taking into consideration the HMD orientation, avirtual representation of the simulated vehicle design featuresuperimposed on a real-time surrounding-showing video stream derivedfrom real-world image data captured with support from one or morevehicle-attached cameras adapted to capture surroundings external to theroad-driven vehicle, there is provided to the HMD display a real-timephysical world view of surroundings external the road-drivenvehicle—essentially as captured by the vehicle-attachedcamera(s)—electronically mixed with the computer-generated virtualdesign feature representation temporally and spatially commensurate withsaid physical world view such that the surrounding-showing video streamappears as a background overlaid with said virtual design featurerepresentation. Thus, live imagery from the physical world iselectronically merged with computer-generated imagery, a conceptcommonly referred to as mixed reality and/or augmented reality. Morespecifically, the virtual representation of the simulated vehicle designfeature is overlaid the surrounding-showing video stream, a conceptcommonly referred to as video see-through. That is, with thevehicle-attached camera(s) provided to capture surroundings external ofthe road-driven vehicle, the real-time surrounding-showing video streamshows surroundings and/or an environment exterior of the vehicle, henceexcluding interior—and potentially at least partial exterior—views ofsaid road-driven vehicle. Subsequently, with the HMD-wearing occupantbeing on-board the road-driven vehicle—e.g. seated in a driver's seat orpassenger's seat thereof—and with the HMD orientation being taken intoconsideration, provided to the HMD display is then a portion ofsurrounding-showing video stream—derived from real-world image datacaptured with support from the vehicle-attached camera(s)—correspondingto and/or spatially commensurate with a field of view of the HMD-wearingoccupant. The HMD-wearing occupant would accordingly be shown—on the HMDdisplay(s)—a physical world view spatially commensurate with saidoccupant's field of view, but from which physical world view aninterior—and potentially at least a portion of an exterior—of theroad-driven vehicle would be excluded due to the vehicle-attachedcamera(s) capturing surroundings external of—not internal of—theroad-driven vehicle. Thus, the real-time surrounding-showing videostream may then represent what a driver or passenger of said road-drivenvehicle would essentially see even if not wearing the HMD, but withinterior—and potentially at least partial exterior—portions of theroad-driven vehicle removed. Accordingly, with the interior—andpotentially at least a portion of the exterior—of the road-drivenvehicle essentially wiped out from the HMD-wearing occupant's physicalworld view, one or more simulated design features—e.g. represented by asimulated updated and/or new interior or exterior or a portionthereof—may be evaluated in its place. Thus, upon in real-timesuperimposing a virtual representation of a simulated vehicle designfeature—such as e.g. a complete interior and parts of an exterior ore.g. at least a simulated dashboard or a portion thereof—on thesurrounding-showing video stream, said simulated vehicle design featuree.g. simulated dashboard may be evaluated in a road-driven vehicle, e.g.while said road-driven vehicle is driven in real traffic and/or alongactual roads. Thereby, with the exception of the virtual design featurerepresentation, the entire test environment is authentic and/or real.Consequently, the simulated vehicle design feature may be evaluated inreal traffic and/or in real road-driving scenarios, which thus enablessaid simulated vehicle design feature to be evaluated under morereality-resembling conditions and/or in a more reality-resemblingenvironment than should said evaluation be performed in e.g. a commonlyknown physical mock-up.

“Providing” to a HMD display may refer to “providing wirelessly”,“rendering” and/or “transmitting” to a HMD display and/or “generating,processing, rendering and/or producing, and providing” to a HMD display,whereas “HMD display” may refer to “one or more HMD displays”. Providing“in real-time”, on the other hand, may refer to providing “essentiallyin real-time” and/or “live”, and further to that the virtualrepresentation superimposed on the real-world video stream is providedto the HMD display substantially close to the time of the actualcapturing of the real-world image data. According to an example,“providing in real-time” may refer to merely “providing”. The expression“taking into consideration” the HMD orientation may refer to“considering” and/or “taking into consideration for positioning and/orspatial positioning” the HMD orientation, whereas “taking intoconsideration the HMD orientation” may refer to “taking intoconsideration a field of view of the occupant derived from the HMDorientation” and/or “taking into consideration the HMD orientationand/or a field of view of the occupant derived from the HMDorientation”. “Virtual” representation, on the other hand, may refer to“augmented” and/or “overlaid” representation, whereas “representation”may refer to “augmentation”, “data” and/or “geometrical and/or graphicalmodel”. According to an example, “representation” may further refer to“graphical model”, “computer-aided design, CAD, geometrics and/or designsurface model, DSM, geometrics” and/or “result from computer-aidedengineering, CAE”. “Superimposed on” a real-time surrounding-showingvideo stream, on the other hand, may refer to “overlaid”, “virtuallyoverlaid”, “placed and/or displayed in front of” a real-timesurrounding-showing video stream, whereas “a real-time”surrounding-showing video stream may refer to “an essentiallyreal-time”, “a live or essentially live” and/or “instant or essentiallyinstant” surrounding-showing video stream. The term “real-time”surrounding-showing video stream may further indicate that thesurrounding-showing video stream is derived in a timeframe substantiallyclose to the time of the actual capturing of the real-world image data.“Real-world”, on the other hand, may refer to “physical world” and/or“real environment world”, whereas “video stream” may refer to “streamingvideo” and/or merely “video”. “Derived from” real-world image data mayrefer to “which video stream is based on” real-world image data, whereas“real-world image data” may refer to “video data” and/or “images”.“Captured” with support from one or more vehicle-attached cameras, onthe other hand, may refer to “taped” and/or “filmed” with support fromone or more vehicle-attached cameras, whereas captured “with supportfrom” one or more vehicle-attached cameras may refer to captured “by”and/or “by means of” one or more vehicle-attached cameras. Furthermore,“one or more” vehicle-attached cameras may according to an example referto “at least two” vehicle-attached cameras, whereas “vehicle-attachedcameras” may refer to “cameras fixed to, mounted on and/or comprised inthe road-driven vehicle”, and further to “vehicle-attachedsurrounding-capturing cameras”. The expression “adapted to capture”surroundings external to the road-driven vehicle may refer to “adaptedto film and/or record” and/or “adapted to capture images of”surroundings external to the road-driven vehicle, and further to“capturing” surroundings external to the road-driven vehicle. Moreover,“external of” the road-driven vehicle may refer to “on the outside of”the road-driven vehicle, and further to “external to” and/or merely“external” the road-driven vehicle.

According to an example, the expression “adapted to capture surroundingsexternal to the road-driven vehicle” may refer to “adapted to capturesurroundings external to the road-driven vehicle at least in a forwarddirection of the road-driven vehicle, preferably additionally in asideway, backward, upward and/or downward direction of the road-drivenvehicle”. According to another example, the expression “real-timesurrounding-showing video stream derived from real-world image datacaptured with support from one or more vehicle-attached cameras adaptedto capture surroundings external of the road-driven vehicle” may referto “real-time surrounding-showing video stream derived from real-worldimage data captured with support from one or more vehicle-attachedcameras adapted to capture surroundings external of the road-drivenvehicle, wherein the real-time surrounding-showing video streamcomprises a first real-time video stream from a first vehicle-attachedcamera adapted to capture surroundings external of the road-drivenvehicle in a first direction, stitched with at least a second real-timevideo stream from at least a second vehicle-attached camera adapted tocapture surroundings external of the road-driven vehicle in a seconddirection differing from the first direction”.

Optionally, the simulated vehicle design feature may comprise asimulated vehicle interior section and/or a simulated vehicle exteriorsection. Thereby, a virtual vehicle interior portion—e.g. a simulateddashboard—and/or a virtual vehicle exterior portion—e.g. a simulatedhood—may be evaluated in the road-driven vehicle, such as e.g. newand/or updated design, colour, material and/or user interface thereofand/or e.g. geometrics for instance CAD and/or DSM geometrics thereof.The expression simulated “vehicle interior section” may refer tosimulated “at least a portion of a vehicle interior section”, andfurther to simulated “vehicle interior portion” and/or simulated “visualand/or uncovered vehicle interior section”. In a similar manner, theexpression simulated “vehicle exterior section” may refer to simulated“at least a portion of a vehicle exterior section”, and further tosimulated “vehicle exterior portion” and/or simulated “visual and/oruncovered vehicle exterior section”.

Optionally, the vehicle feature evaluation system may determine asimulated vehicle functionality feature to be evaluated in theroad-driven vehicle. Providing to the HMD display may then furthercomprise additionally providing in real-time to the HMD display of theHMD, taking into consideration the HMD orientation, a virtualrepresentation of the simulated vehicle functionality featuresuperimposed on the real-time surrounding-showing video stream. Thesimulated vehicle functionality feature may e.g. comprise a simulatedvehicle human machine interface, HMI, a simulated vehicle display, asimulated vehicle head-up display, HUD, simulated light characteristics,and/or a simulated effect resulting from a simulation of the simulatedvehicle functionality feature. Thereby, there is defined—e.g.computer-generated—a virtual vehicle functionality feature of interestto validate in a real vehicle. Furthermore, thereby, the virtualrepresentation of the simulated vehicle functionality feature isoverlaid the real-world video stream to be temporally and spatiallycommensurate with the video stream such that said video stream appearsas a background overlaid with—in addition to the virtual design featurerepresentation—said virtual functionality feature representation.Accordingly, upon in real-time superimposing a virtual representation ofa simulated vehicle functionality feature—such as for instance a virtualdisplay with e.g. new and/or updated design and/or functionality—on thesurrounding-showing video stream, said simulated vehicle functionalityfeature may be evaluated in the road-driven vehicle, e.g. while saidroad-driven vehicle is driven in real traffic and/or along actual roads.Consequently, the simulated vehicle functionality feature may beevaluated in real traffic and/or in real road-driving scenarios, whichthus enables said simulated vehicle functionality feature to beevaluated under more reality-resembling conditions and/or in a morereality-resembling environment than should said evaluation be performedin e.g. a commonly known static or dynamic rig displaying theenvironment and traffic on large scale screens in front of a vehiclemock-up. Should the simulated vehicle functionality feature comprise asimulated vehicle human machine interface, HMI, then a virtual vehicleHMI may be evaluated in the road-driven vehicle, such as e.g. graphicsthereof and/or new and/or updated functionality and/or design thereof.On the other hand, should the simulated vehicle functionality featureadditionally or alternatively comprise a simulated vehicle display, thena virtual vehicle display e.g. an infotainment display may be evaluatedin the road-driven vehicle, such as e.g. graphics thereof and/or newand/or updated functionality and/or design thereof. Moreover, should thesimulated vehicle functionality feature additionally or alternativelycomprise a simulated vehicle head-up display, HUD, then a virtualvehicle HUD may be evaluated in the road-driven vehicle, such as e.g.graphics thereof and/or new and/or updated functionality and/or designthereof. Should the simulated vehicle functionality feature on the otherhand additionally or alternatively comprise simulated lightcharacteristics, then virtual light characteristics e.g. interior lightcharacteristics may be evaluated in the road-driven vehicle, such ase.g. new and/or updated appearance and/or ambience of e.g. interiorlighting. Moreover, should the simulated vehicle functionality featureadditionally or alternatively comprise a simulated effect resulting froma simulation of the simulated vehicle functionality feature, then avirtual effect resulting from simulation of a simulated vehiclefunctionality feature e.g. wiper performance, cabin climate, air flow,contamination etc. may be evaluated in the road-driven vehicle, such ase.g. the effect of a computer-aided engineering, CAE, simulationthereof. “Determining” a simulated vehicle functionality feature mayrefer to “computer-generating”, “simulating” and/or “modelling” asimulated vehicle functionality feature, whereas vehicle “functionalityfeature” may refer to vehicle “characteristics” and further to merelyvehicle “feature” and/or vehicle “functionality”. According to anexample, “determining” a simulated vehicle functionality feature mayrefer to “determining logic, design, graphics, aesthetics, geometriesand/or functionality of” a simulated vehicle functionality feature. Theexpression that the simulated vehicle functionality feature “comprises”may refer to that the simulated vehicle functionality feature “isrepresented by”, whereas light “characteristics” may refer to light“position(s)”, “positioning”, “function(s)”, “ambience” and/or“appearance”.

Optionally, the vehicle feature evaluation system may determine asimulated object feature to be evaluated in the road-driven vehicle.Providing to the HMD display may then further comprise additionallyproviding in real-time to the HMD display of the HMD, taking intoconsideration the HMD orientation, a virtual representation of thesimulated object feature superimposed on the real-timesurrounding-showing video stream. The simulated object feature may e.g.comprise a simulated other vehicle, a simulated road user, and/or asimulated moving or fixed obstacle. Thereby, there is defined—e.g.computer-generated—a virtual object of interest to validate in a realvehicle. Furthermore, thereby, the virtual representation of thesimulated object feature is overlaid the real-world video stream to betemporally and spatially commensurate with the video stream such thatsaid video stream appears as a background overlaid with—in addition tothe virtual design feature representation—said virtual object featurerepresentation. Accordingly, upon in real-time superimposing a virtualrepresentation of a simulated object feature—such as for instance avirtual pedestrian appearing to cross the road in front of theroad-driven vehicle—on the surrounding-showing video stream, saidsimulated object feature and/or an effect it has on the HMD-wearingoccupant—who for instance may be the driver of the road-drivenvehicle—may be evaluated, e.g. while said road-driven vehicle is drivenin real traffic and/or along actual roads. Consequently, the simulatedobject feature—and/or an effect it has on the HMD-wearing occupant—maybe evaluated in real traffic and/or in real road-driving scenarios,which thus enables said simulated object feature and/or the effect ithas on the HMD-wearing occupant to be evaluated under morereality-resembling conditions and/or in a more reality-resemblingenvironment than should said evaluation be performed in e.g. a commonlyknown static or dynamic rig displaying the environment and traffic onlarge scale screens in front of a vehicle mock-up. Should the simulatedobject feature comprise a simulated other vehicle, e.g. appearing todrive in front of the road-driven vehicle, then a virtual vehicle may beevaluated in the road-driven vehicle, such as e.g. graphics thereofand/or new and/or updated design thereof, and/or an effect it has on theHMD-wearing occupant. On the other hand, should the simulated objectfeature additionally or alternatively comprise a simulated road user,e.g. appearing to cross the road in front of the road-driven vehicle,then a virtual road user—and/or an effect it has on the HMD-wearingoccupant—may be evaluated in the road-driven vehicle. Moreover, shouldthe simulated object feature additionally or alternatively comprise asimulated moving or fixed obstacle, e.g. an elk appearing to e.g. bestanding on or crossing the road in front of the road-driven vehicle,then a virtual moving or fixed obstacle—and/or an effect it has on theHMD-wearing occupant—may be evaluated in the road-driven vehicle.“Determining” a simulated object feature may refer to“computer-generating”, “simulating” and/or “modelling” a simulatedobject feature, whereas “object” may refer to “physical object”,“exterior object” and/or “object exterior of the road-driven vehicle”.“Object feature” may further refer to merely “object” According to anexample, “determining” a simulated object feature may refer to“determining logic, design, graphics, aesthetics, geometries and/orfunctionality of” a simulated object feature, whereas the expressionthat the simulated object feature “comprises” may refer to that thesimulated object feature “is represented by”. “Other vehicle” may referto “a vehicle” and/or “road-driven vehicle”, whereas “road user” mayindicate anyone who uses a road such as e.g. a pedestrian, cyclist,motorist etc.

Optionally, the vehicle feature evaluation system may determine afictive location of the simulated design feature relative theroad-driven vehicle. The above discussed providing of the virtual designfeature representation taking into consideration the HMD orientation maythen comprise providing the virtual design feature representationsuperimposed on the real-time surrounding-showing video stream such thatpositioning of the virtual design feature representation corresponds tothe fictive design feature location. Thereby, it is provided that thepositioning of the overlaid virtual design feature representation on thereal-world video stream spatially commensurate with the intended fictivevehicle location of the vehicle design feature to be simulated. Thefictive design feature location may be arbitrarily selected as deemedrelevant for the implementation at hand, and may further be of anyarbitrary form, size and/or dimensions ranging from a few millimetres upto hundreds or even thousands of millimetres across. Additionally oralternatively, optionally, the vehicle feature evaluation system maydetermine a fictive location of the simulated vehicle functionalityfeature relative the road-driven vehicle. The above discussed optionalproviding of the virtual functionality feature representation takinginto consideration the HMD orientation may then comprise providing thevirtual functionality feature representation superimposed on thereal-time surrounding-showing video stream such that positioning of thevirtual functionality feature representation corresponds to the fictivefunctionality feature location. Thereby, it is provided that thepositioning of the overlaid virtual functionality feature representationon the real-world video stream spatially commensurate with the intendedfictive vehicle location of the vehicle functionality feature to besimulated. The fictive functionality feature location may be arbitrarilyselected as deemed relevant for the implementation at hand, and mayfurther be of any arbitrary form, size and/or dimensions ranging from afew millimetres up to hundreds or even thousands of millimetres across.Additionally or alternatively, optionally, the vehicle featureevaluation system may determine a fictive location of the simulatedobject feature relative the road-driven vehicle. The above discussedoptional providing of the virtual object feature representation takinginto consideration the HMD orientation may then comprise providing thevirtual object feature representation superimposed on the real-timesurrounding-showing video stream such that positioning of the virtualobject feature representation corresponds to the fictive object featurelocation. Thereby, it is provided that the positioning of the overlaidvirtual object feature representation on the real-world video streamspatially commensurate with the intended fictive location of the objectfeature to be simulated. The fictive object feature location may bearbitrarily selected as deemed relevant for the implementation at handand may further for instance refer to a location outside the road-drivenvehicle, such as e.g. in front of the road-driven vehicle, e.g. a fewmillimetres therefrom up to many thousands of millimetres therefrom.“Determining” a fictive location may refer to “mapping” a fictivelocation, whereas “fictive” location may refer to “intended” and/or“virtual” location. Fictive “location”, on the other hand, may refer tofictive “position” and/or “placement”, whereas “relative” theroad-driven vehicle may refer to “in relation to” and/or “within” theroad-driven vehicle. “Corresponds to” the fictive location may refer to“commensurate with”, “reflects” and/or “represents” the fictivelocation.

Optionally, the vehicle feature evaluation system may further compriseupdating the virtual functionality feature representation based on auser interaction with the simulated vehicle functionality feature.Thereby, interaction by a user with the simulated vehicle functionalityfeature may result in that the virtual representation of the simulatedvehicle functionality feature is updated in accordance with saidinteraction. That is, user interaction with the simulated vehiclefunctionality feature, which feature for instance is represented byselectable options available on a simulated vehicle display, may resultin that a user selected option is carried out and/or updated inaccordance with the user interaction, which subsequently is reflected bythe corresponding virtual functionality feature being updated inaccordance therewith. The user interaction may be based on detection, bymeans of one or more user interaction sensors, of a user in and/or atthe fictive functionality feature location. Thereby, presence of a user,e.g. the HMD-wearing occupant, and/or e.g. a finger of saiduser/occupant, may be sensed in or at the position in the vehiclerepresenting the location of the simulated vehicle functionalityfeature, whereby the virtual representation of the simulated vehiclefunctionality feature subsequently may be updated in accordance withsaid presence, and/or in accordance with the geographical positionand/or the nature of said presence. User interaction may be detected inany arbitrary manner known in the art, e.g. by means of one or more userinteraction sensors and/or a user interaction determining system, forinstance comprising touch sensor(s), camera(s) and/or position detectionsensor(s) worn by the user e.g. on his/her hand and/or finger. Theexpression “updating” the virtual functionality feature representationmay refer to “updating content, graphical data and/or geometric data of”the virtual functionality feature representation, whereas “based on a”user interaction may refer to “as a result of” user interaction and/or“based on input data and/or one or more signals derived from” userinteraction. “User interaction”, on the other hand, may refer to“occupant interaction”. The expression detection “by means of” one ormore user interaction sensors may refer to detection “with support from”and/or “with input from” one or more user interaction sensors. Detection“of a user”, on the other hand, may refer to detection “of theoccupant”, and further to detection “of a hand and/or one or morefingers of a user”. The expression “in and/or at” the fictivefunctionality feature location may refer to “in or at a location withinthe vehicle representing” the fictive functionality feature location.

Additionally or alternatively, optionally, the vehicle featureevaluation system may further comprise updating the virtualfunctionality feature representation based on a vehicle signal affectingthe simulated vehicle functionality feature, derived from theroad-driven vehicle. Thereby, deriving a vehicle signal which affectsthe simulated vehicle functionality feature—e.g. resulting frommanoeuvring of and/or user interaction with the road-drivenvehicle—results in that the virtual representation of the simulatedvehicle functionality feature is updated in accordance therewith. Thatis, deriving—from the road-driven vehicle—a vehicle signal affecting thesimulated vehicle functionality feature, where the vehicle signal forinstance comprises vehicle data such as e.g. fuel consumption and wherethe simulated vehicle functionality feature for instance is representedby a simulated vehicle display showing said vehicle data e.g. fuelconsumption, may result in that the virtual functionality feature—inthis example the virtual vehicle display—is updated in accordance withsaid vehicle signal, i.e. the fuel consumption value shown on thevirtual display is updated along with the received vehicle signalcomprising an updated fuel consumption value. The vehicle signal may bederived from the road-driven vehicle in any arbitrary known manner, forinstance via wired and/or wireless communication therewith, and/or withsupport from a vehicle signal determining system and/or unit adapted fordetermining which input derived from the road-driven vehicle affects thesimulated vehicle functionality feature. The expression “updating” thevirtual functionality feature representation may refer to “updatingcontent, graphical data and/or geometric data of” the virtualfunctionality feature representation, whereas “based on a” vehiclesignal may refer to “based on input and/or data from a” vehicle signal.“Derived from” the road-driven vehicle, on the other hand, may refer to“received from” the road-driven vehicle. According to an example,“updating the virtual functionality feature representation based on avehicle signal affecting the simulated vehicle functionality feature,derived from the road-driven vehicle” may refer to “updating the virtualfunctionality feature representation based on a vehicle signal derivedfrom the road-driven vehicle, which vehicle signal is based on amanoeuvring of and/or user interaction with the road-driven vehicleaffecting the simulated vehicle functionality feature”.

Optionally, the vehicle feature evaluation system may update thereal-time video stream, the superimposed virtual design featurerepresentation, the superimposed virtual functionality featurerepresentation and/or the superimposed virtual object featurerepresentation based on updated captured image data and/or based onupdated determined HMD orientation. Thereby, it is provided that thereal-time video stream and/or the virtual representation(s) arecontinuously updated to reflect updated captured image data and/orupdated orientation of the HMD. “Updating” may refer to “continuouslyand/or intermittently updating”.

According to a second aspect of embodiments herein, the object isachieved by a vehicle feature evaluation system for—and/or adaptedfor—enabling evaluation of a simulated vehicle-related feature. Thevehicle feature evaluation system comprises a HMD orientationdetermining unit for—and/or adapted for—determining in relation to aroad-driven vehicle, with support from a tracking system, an orientationof a head-mounted display, HMD, adapted to be worn by an occupanton-board the road-driven vehicle. The vehicle feature evaluation systemfurther comprises a design feature determining unit for—and/or adaptedfor—determining a simulated vehicle design feature to be evaluated inthe road-driven vehicle. Moreover, the vehicle feature evaluation systemcomprises a HMD providing unit for—and/or adapted for—providing inreal-time to a HMD display of the HMD, taking into consideration the HMDorientation, a virtual representation of the simulated vehicle designfeature superimposed on a real-time surrounding-showing video streamderived from real-world image data captured with support from one ormore vehicle-attached cameras adapted to capture surroundings externalto the road-driven vehicle.

Optionally, the simulated vehicle design feature may comprise asimulated vehicle interior section and/or a simulated vehicle exteriorsection.

Optionally, the vehicle feature evaluation system may comprise afunctionality feature determining unit. The HMD providing unit may thenbe adapted for additionally providing in real-time to the HMD display ofthe HMD, taking into consideration the HMD orientation, a virtualrepresentation of the simulated vehicle functionality featuresuperimposed on the real-time surrounding-showing video stream. Thesimulated vehicle functionality feature may e.g. comprise a simulatedvehicle human machine interface, HMI, a simulated vehicle display, asimulated vehicle head-up display, HUD, light characteristics, and/or asimulated effect resulting from a simulation of the simulated vehiclefunctionality feature.

Optionally, the vehicle feature evaluation system may comprise an objectfeature determining unit. The HMD providing unit may then be adapted foradditionally providing in real-time to the HMD display of the HMD,taking into consideration the HMD orientation, a virtual representationof the simulated object feature superimposed on the real-timesurrounding-showing video stream. The simulated object feature may e.g.comprise a simulated other vehicle, a simulated road user, and/or asimulated moving or fixed obstacle.

Optionally, the vehicle feature evaluation system may further comprise alocation determining unit for—and/or adapted for—determining a fictivedesign feature location of the simulated vehicle design feature relativethe road-driven vehicle. The HMD providing unit may then be furtheradapted for providing the virtual design feature representationsuperimposed on the real-time surrounding-showing video stream such thatpositioning of the virtual design feature representation corresponds tothe fictive design feature location.

Additionally or alternatively, the optional location determining unitmay be for—and/or adapted for—determining a fictive functionalityfeature location of the simulated vehicle functionality feature relativethe road-driven vehicle. The HMD providing unit may then be furtheradapted for providing the virtual functionality feature representationsuperimposed on the real-time surrounding-showing video stream such thatpositioning of the virtual functionality feature representationcorresponds to the fictive functionality feature location. Additionallyor alternatively, the optional location determining unit may befor—and/or adapted for—determining a fictive object feature location ofthe simulated object feature relative the road-driven vehicle. The HMDproviding unit may then be further adapted for providing the virtualobject feature representation superimposed on the real-timesurrounding-showing video stream such that positioning of the virtualobject feature representation corresponds to the fictive object featurelocation.

Optionally, the vehicle feature evaluation system may further comprise auser interaction updating unit for—and/or adapted for—updating thevirtual functionality feature representation based on a user interactionwith the simulated vehicle functionality feature. The user interactionmay be based on detection, by means of one or more user interactionsensors, of a user in and/or at the fictive functionality featurelocation. Additionally or alternatively, optionally, the vehicle featureevaluation system may further comprise a vehicle signal updating unitfor—and/or adapted for—updating the virtual functionality featurerepresentation based on a vehicle signal affecting the simulated vehiclefunctionality feature, derived from the road-driven vehicle.

Optionally, the vehicle feature evaluation system may further comprise acontinuous updating unit for—and/or adapted for—updating the real-timevideo stream, the superimposed virtual design feature representation,the superimposed virtual functionality feature representation and/or thesuperimposed virtual object feature representation based on updatedcaptured image data and/or based on updated determined HMD orientation.

Similar advantages as those mentioned in the foregoing in relation tothe first aspect correspondingly apply to the second aspect, and are notfurther discussed.

According to a third aspect of embodiments herein, the object isachieved by a vehicle—e.g. a road-driven vehicle—comprising a vehiclefeature evaluation system as discussed above. Again, similar advantagesas those mentioned in the foregoing in relation to the first aspectcorrespondingly apply to the third aspect, and are not furtherdiscussed.

According to a fourth aspect of embodiments herein, the object isachieved by a computer program product comprising a computer programcontaining computer program code means arranged to cause a computer or aprocessor to execute the steps of the vehicle feature evaluation systemdiscussed in the foregoing, stored on a computer-readable medium or acarrier wave. Yet again, similar advantages as those mentioned in theforegoing in relation to the first aspect correspondingly apply to thefourth aspect, and are not further discussed.

BRIEF DESCRIPTION OF THE DRAWINGS

The various aspects of the non-limiting embodiments, includingparticular features and advantages, will be readily understood from thefollowing detailed description and the accompanying drawings, in which:

FIG. 1 illustrates a schematic view of an exemplifying vehicle featureevaluation system according to embodiments of the disclosure;

FIG. 2 illustrates a schematic view of the vehicle feature evaluationsystem of FIG. 1 in greater detail;

FIG. 3 illustrates a schematic view of the vehicle feature evaluationsystem of FIG. 1 in yet further greater detail;

FIG. 4 illustrates a schematic view of an alternative vehicle featureevaluation system according to embodiments of the disclosure;

FIG. 5 is a schematic block diagram illustrating an exemplifying vehiclefeature evaluation system according to embodiments of the disclosure;and

FIG. 6 is a flowchart depicting an exemplifying method performed by avehicle feature evaluation system according to embodiments of thedisclosure.

DETAILED DESCRIPTION

Non-limiting embodiments of the present disclosure will now be describedmore fully hereinafter with reference to the accompanying drawings, inwhich currently preferred embodiments of the disclosure are shown. Thisdisclosure may, however, be embodied in many different forms and shouldnot be construed as limited to the embodiments set forth herein. Likereference characters refer to like elements throughout. Dashed lines ofsome boxes in the figures indicate that these units or actions areoptional and not mandatory. In the following, according to embodimentsherein which relate to enabling evaluation of a simulatedvehicle-related feature, there will be disclosed an approach whichenables a virtual version of a feature related to and/or associated witha vehicle to be evaluated without a need to build a physical mock-up forevaluation.

Referring now to the figures and FIGS. 1-3 in particular, there isdepicted a schematic view of an exemplifying vehicle feature evaluationsystem 1 according to embodiments of the disclosure. The vehicle featureevaluation system 1 is here comprised in a road-driven vehicle 2, namelyan exemplifying a passenger car. Provided on the road-driven vehicle 2are one or more vehicle-attached cameras 21—here three essentiallyforward-facing cameras 21—adapted to capture surroundings external ofthe road-driven vehicle 2. On-board said vehicle 2 is an occupant 3,wearing an HMD 4, the orientation of which—in relation to the vehicle2—may be determined with support from a tracking system 5 (shown inFIGS. 2-3). The HMD 4 comprises at least one HMD display 41, here twodisplays, on which it is displayed a real-time surrounding-showing videostream 6 derived from real-world image data 211 (shown in FIGS. 2-3)captured with support from the one or more vehicle-attached cameras 21.Superimposed on said video stream 6 is a virtual representation 7 of asimulated vehicle design feature to be evaluated in the road-drivenvehicle 2. The simulated vehicle design feature here comprises anexemplifying simulated vehicle interior section, at least comprising asimulated dashboard and steering wheel, and the virtual representation 7is accordingly here represented by a virtual interior section comprisingan exemplifying virtual dashboard and virtual steering wheel. Thesimulated vehicle design feature may have a fictive design featurelocation 70 relative the vehicle 2, and for the exemplifying simulatedvehicle interior section in FIGS. 1-3, the fictive design featurelocation 70 is in an exemplifying manner essentially situated wherethe—to the HMD-wearing occupant 3 invisible—dashboard and steering wheelof the road-driven vehicle 2 are situated. According to otherembodiments, a simulated vehicle design feature may additionally oralternatively optionally comprise a simulated vehicle exterior section.Superimposed on the surrounding-showing video stream 6 is additionallyan optional virtual representation 8 of a simulated vehiclefunctionality feature to be evaluated in the road-driven vehicle 2. Thesimulated vehicle functionality feature here comprises an exemplifyingsimulated vehicle display, more specifically a simulated infotainmentdisplay, and the virtual functionality feature representation 8 isaccordingly here represented by a virtual infotainment display. Thesimulated vehicle functionality feature may have a fictive functionalityfeature location 80 relative the vehicle 2, and for the exemplifyingsimulated infotainment display in FIGS. 1-3, the fictive functionalityfeature location 80 is in an exemplifying manner essentially centered ona dashboard of the road-driven vehicle 2 and/or essentially centered onthe virtual dashboard 7. Additionally depicted is an exemplifyingalternative virtual functionality feature representation 8′ of analternative simulated vehicle functionality feature. The alternativesimulated vehicle functionality feature here comprises an optionalexemplifying simulated driver information display, and the alternativevirtual representation 8′ is then accordingly represented by anexemplifying virtual driver information display. The simulated driverinformation display here has an exemplifying fictive functionalityfeature location 80′ on the vehicle dashboard of the road-driven vehicle2 and/or on the virtual dashboard 7, in front of a driver's seat of theroad-driven vehicle 2. According to other embodiments, a simulatedvehicle functionality feature may additionally or alternativelyoptionally comprise e.g. a simulated vehicle HMI, a simulated HUD,simulated light characteristics and/or a simulated effect resulting froma simulation of the simulated vehicle functionality feature.Additionally shown in FIG. 3 is an optional server 10, which will bedescribed in greater detail in conjunction with FIG. 5.

FIG. 4. illustrates a schematic view of an alternative vehicle featureevaluation system 1 according to embodiments of the disclosure.Superimposed on the surrounding-showing video stream 6 is hereadditionally an optional virtual representation 9 of a simulated objectfeature to be evaluated in the road-driven vehicle 2. The simulatedobject feature here comprises an exemplifying simulated road user,namely a pedestrian, and the virtual object feature representation 9 isaccordingly here represented by a virtual road user 91, namely a virtualpedestrian, in an exemplifying manner crossing the street in front ofthe road-driven vehicle 2. The simulated object feature may have afictive object feature location 90 relative the vehicle 2, and for theexemplifying simulated pedestrian in FIG. 4, the fictive object featurelocation 90 is in an exemplifying manner essentially a few meters infront of the road-driven vehicle 2. According to other embodiments, asimulated object feature may additionally or alternatively optionallye.g. comprise a simulated other vehicle and/or a simulated moving orfixed obstacle.

As further shown in FIG. 5, which is a schematic block diagramillustrating an exemplifying vehicle feature evaluation system 1according to embodiments of the disclosure, the vehicle featureevaluation system 1 comprises a HMD orientation determining unit 101, adesign feature determining unit 102, an optional functionality featuredetermining unit 103, an optional object feature determining unit 104,an optional location determining unit 105, a HMD providing unit 106, anoptional user interaction updating unit 107, an optional vehicle signalupdating unit 108, and an optional continuous updating unit 109, all ofwhich will be described in greater detail in conjunction with FIG. 6.Furthermore, the embodiments herein for enabling evaluation of asimulated vehicle-related feature, may be implemented through one ormore processors, such as a processor 110, here denoted CPU/GPU, togetherwith computer program code for performing the functions and actions ofthe embodiments herein. Said program code may also be provided as acomputer program product, for instance in the form of a data carriercarrying computer program code for performing the embodiments hereinwhen being loaded into the vehicle feature evaluation system 1. One suchcarrier may be in the form of a CD ROM disc and/or a hard drive. It ishowever feasible with other data carriers such as a memory stick. Thecomputer program code may furthermore be provided as pure program codeon a server and downloaded to the vehicle feature evaluation system 1.The vehicle feature evaluation system 1 may further comprise a memory111 comprising one or more memory units. The memory 111 may be arrangedto be used to store e.g. information, and further to store data,configurations, schedulings, and applications, to perform the methodsherein when being executed in the vehicle feature evaluation system 1.For instance, the computer program code may be implemented in thefirmware, stored in FLASH memory 111, of an embedded processor 110,and/or downloaded from online. Furthermore, said units 101, 102, 103,104, 105, 106, 107, 108, and/or 109 described above, the optionalprocessor 110 and/or the optional memory 111, may at least partly becomprised in the server 10, which server 10 may be comprised in and/orcarried onboard the road-driven vehicle 2. Those skilled in the art willalso appreciate that said units 101, 102, 103, 104, 105, 106, 107, 108,and/or 109 described above, and which will be described in more detaillater on in this description, may refer to a combination of analog anddigital circuits, and/or one or more processors configured with softwareand/or firmware, e.g. stored in a memory such as the memory 111, thatwhen executed by the one or more processors such as the processor 110perform as will be described in more detail in conjunction with FIG. 6.One or more of these processors, as well as the other digital hardware,may be included in a single ASIC (Application-Specific IntegratedCircuitry), or several processors and various digital hardware may bedistributed among several separate components, whether individuallypackaged or assembled into a SoC (System-on-a-Chip). Further shown inFIG. 5 is an exemplifying optional user interaction determining system1070, adapted for determining user interaction by a user e.g. theoccupant 3 with the simulated vehicle functionality feature—here theexemplifying simulated vehicle infotainment display. The userinteraction determining system 1070 may for instance comprise touchsensor(s), camera(s) and/or position detection sensor(s) worn by theuser e.g. on his/her hand and/or finger. Also depicted is anexemplifying optional vehicle signal determining unit 1080, adapted fordetermining which input derived from the road-driven vehicle 2 affectsthe simulated vehicle functionality feature—here the exemplifyingsimulated vehicle infotainment display—e.g. during manoeuvring of saidvehicle 2.

FIG. 6 is a flowchart depicting an exemplifying method performed by avehicle feature evaluation system 1 according to embodiments of thedisclosure. Said method is for enabling evaluation of a simulatedvehicle-related feature. The exemplifying method, which may becontinuously repeated, comprises the following actions discussed withsupport from FIGS. 1-5.

Action 1001

In Action 1001, the vehicle feature evaluation system 1 determines inrelation to the road-driven vehicle 2—e.g. by means of the HMDorientation determining unit 101—with support from the tracking system5, an orientation of the HMD 4 adapted to be worn by the occupant 3on-board the road-driven vehicle 2. Thus, as shown with support from atleast FIGS. 1, 2, 3 and 5, there is established a position and/orlocation of an occupant-worn HMD 4 in view of a real vehicle 2 e.g.adapted to and/or intended to be driven outdoors such as in real trafficand/or along actual roads.

Action 1002

In Action 1002, the vehicle feature evaluation system 1 determines—e.g.by means of the design feature determining unit 102—a simulated vehicledesign feature to be evaluated in the road-driven vehicle 2. Thus, asshown with support from at least FIGS. 1, 2, 3 and 5, there is defined,e.g. computer-generated, a virtual vehicle design feature—optionally asimulated interior section e.g. comprising at least a simulateddashboard and a simulated steering wheel—of interest to validate in areal vehicle 2. Thereby, the virtual interior section 7—here the virtualinterior section and/or virtual steering wheel—may be evaluated in theroad-driven vehicle 2, such as e.g. new and/or updated design, colour,material and/or user interface thereof and/or e.g. geometrics forinstance CAD and/or DSM geometrics thereof. Optionally, additionally oralternatively, the simulated vehicle design feature may comprise asimulated vehicle exterior section.

Action 1003

In optional Action 1003, the vehicle feature evaluation system 1 maydetermine—e.g. by means of the functionality feature determining unit103—a simulated vehicle functionality feature to be evaluated in theroad-driven vehicle 2. Thus, as shown with support from at least FIGS.1, 2, 3 and 5, there is defined, e.g. computer-generated, a virtualvehicle functionality feature—optionally a simulated vehicleinfotainment display—of interest to validate in a real vehicle 2.Thereby, the virtual functionality feature 7—here the virtualinfotainment display 7—may be evaluated in the road-driven vehicle 2,such as e.g. graphics thereof and/or new and/or updated functionalityand/or design thereof. Optionally, additionally or alternatively, thesimulated vehicle functionality feature may comprise a simulated vehiclehuman machine interface, HMI, a simulated vehicle head-up display, HUD,simulated light characteristics, and/or a simulated effect resultingfrom a simulation of the simulated vehicle functionality feature.

Action 1004

In optional Action 1004, the vehicle feature evaluation system 1 maydetermine—e.g. by means of the object feature determining unit 104—asimulated object feature to be evaluated in the road-driven vehicle 2.Thus, as shown with support from FIG. 4 and further from FIGS. 1, 2, 3and 5, there is defined, e.g. computer-generated, a virtual objectfeature 9—optionally a simulated road user 91—of interest to validate ina real vehicle 2. Thereby, a virtual road user 9—and/or an effect it hason the HMD-wearing occupant 3—may be evaluated in the road-drivenvehicle 2. Optionally, additionally or alternatively, the simulatedobject feature may comprise a simulated other vehicle, and/or asimulated moving or fixed obstacle.

Action 1005

In optional Action 1005, the vehicle feature evaluation system 1 maydetermine—e.g. by means of the location determining unit 105—a fictivedesign feature location 70 of the simulated vehicle design featurerelative the road-driven vehicle 2. Thus, as shown with support from atleast FIGS. 1, 2, 3 and 5, the fictive design feature location 70 of thesimulated vehicle design feature—optionally the simulated interiorsection—may be determined to have a location in relation to the vehicle2, e.g. in the case of the simulated dashboard and/or simulated steeringwheel be located for instance where the—to the HMD-wearing occupant 3invisible—dashboard and steering wheel of the road-driven vehicle 2 aresituated.

Should optional Action 1005 discussed above be preceded by Action 1003of determining a fictive functionality feature location, then may inoptional Action 1005 the vehicle feature evaluation system 1,additionally or alternatively, determine—e.g. by means of the locationdetermining unit 105—a fictive functionality feature location 80 of thesimulated vehicle functionality feature relative the road-driven vehicle2. Thus, as shown with support from at least FIGS. 1, 2, 3 and 5, thefictive functionality feature location 80 of the simulated vehiclefunctionality feature—optionally the simulated vehicle display—may bedetermined to have a location in relation to the vehicle 2, e.g. in thecase of the simulated infotainment display be located essentiallycentered on the dashboard of the road-driven vehicle 2 and/oressentially centered on the virtual dashboard 7.

Should optional Action 1005 discussed above be preceded by Action 1004of determining a fictive object feature location, then may in optionalAction 1005 the vehicle feature evaluation system 1, additionally oralternatively, determine—e.g. by means of the location determining unit105—a fictive object feature location 90 of the simulated object featurerelative the road-driven vehicle 2. Thus, as shown with support fromFIG. 4 and further from FIGS. 1, 2, 3 and 5, the fictive object featurelocation 90 of the simulated vehicle object feature—optionally thesimulated road user—may be determined to have a location in relation tothe vehicle 2, e.g. in the case of the simulated pedestrian be locatedessentially a few meters in front of the road-driven vehicle 2.

Action 1006

In Action 1006, the vehicle feature evaluation system 1 provides inreal-time to the HMD display 41—e.g. by means of the HMD providing unit106—taking into consideration the HMD orientation, the virtualrepresentation 7 of the simulated vehicle design feature superimposed onthe real-time surrounding-showing video stream 6 derived from real-worldimage data 211 captured with support from the one or moresurrounding-capturing cameras 21 adapted to capture surroundingsexternal of the road-driven vehicle 2. Thus, as shown with support fromat least FIGS. 1, 2, 3 and 5, there is provided to the HMD display 41 areal-time physical world view 6 of surroundings external the road-drivenvehicle 2—essentially as captured by the vehicle-attached camera(s)21—electronically mixed with the computer-generated virtual designfeature representation 7 temporally and spatially commensurate with saidphysical world view 6 such that the surrounding-showing video stream 6appears as a background overlaid with said virtual design featurerepresentation 7. That is, with the vehicle-attached camera(s) 21provided to capture surroundings external of the road-driven vehicle 2,the real-time surrounding-showing video stream 6 shows surroundingsand/or an environment exterior of the vehicle 2, hence excludinginterior—and potentially at least partial exterior—views of saidroad-driven vehicle 2. Subsequently, with the HMD-wearing occupant 3being on-board the road-driven vehicle 2—e.g. seated in a driver's seator passenger's seat thereof—and with the HMD orientation being takeninto consideration—provided to the HMD display 41 is then a portion ofsurrounding-showing video stream 6—derived from real-world image data211 captured with support from the vehicle-attached camera(s)21—corresponding to and/or spatially commensurate with a field of viewof the HMD-wearing occupant 3. The HMD-wearing occupant 3 wouldaccordingly be shown—on the HMD display(s) 41—a physical world viewspatially commensurate with said occupant's field of view, but fromwhich physical world view an interior—and potentially at least a portionof an exterior—of the road-driven vehicle 2 would be excluded due to thevehicle-attached camera(s) 21 capturing surroundings external of—notinternal of—the road-driven vehicle 2. Thus, the real-timesurrounding-showing video stream 6 may then represent what a driver orpassenger of said road-driven vehicle 2 would essentially see even ifnot wearing the HMD 4, but with interior portions of the road-drivenvehicle 2 removed. Accordingly, with the interior—and potentially atleast partial exterior—of the road-driven vehicle 2 essentially wipedout from the HMD-wearing occupant's 3 physical world view, one or moresimulated design features—e.g. represented by a simulated updated and/ornew interior or exterior or a portion thereof—may be evaluated in itsplace.

Optionally, should Action 1006 discussed above be preceded by optionalAction 1003 of determining a simulated vehicle functionality feature tobe evaluated, then Action 1006 may comprise additionally providing inreal-time to the HMD display 41, taking into consideration the HMDorientation, a virtual representation 8 of the simulated vehiclefunctionality feature superimposed on the real-time surrounding-showingvideo stream 6. The simulated vehicle functionality feature may e.g.comprise a simulated vehicle human machine interface, HMI, a simulatedvehicle display, a simulated vehicle head-up display, HUD, simulatedlight characteristics, and/or a simulated effect resulting from asimulation of the simulated vehicle functionality feature. Thus, asshown with support from at least FIGS. 1, 2, 3 and 5, the virtualrepresentation 8 of the simulated vehicle functionality feature isoverlaid the real-world video stream 6 to be temporally and spatiallycommensurate with the video stream 6 such that said video stream 6appears as a background overlaid with—in addition to the virtual designfeature representation 7—said virtual functionality featurerepresentation 8. Accordingly, upon in real-time superimposing a virtualrepresentation 8 of a simulated vehicle functionality feature—such asfor instance a virtual display with e.g. new and/or updated designand/or functionality—on the surrounding-showing video stream 6, saidsimulated vehicle functionality feature may be evaluated in theroad-driven vehicle 2, e.g. while said road-driven vehicle 2 is drivenin real traffic and/or along actual roads. Consequently, the simulatedvehicle functionality feature may be evaluated in real traffic and/or inreal road-driving scenarios, which thus enables said simulated vehiclefunctionality feature to be evaluated under more reality-resemblingconditions and/or in a more reality-resembling environment than shouldsaid evaluation be performed in e.g. a commonly known static or dynamicrig displaying the environment and traffic on large scale screens infront of a vehicle mock-up.

Optionally, should Action 1006 discussed above be preceded by optionalAction 1004 of determining a simulated object feature to be evaluated,then Action 1006 may comprise additionally providing in real-time to theHMD display 41, taking into consideration the HMD orientation, a virtualrepresentation 9 of the simulated object feature superimposed on thereal-time surrounding-showing video stream 6. The simulated objectfeature may e.g. comprise a simulated other vehicle, a simulated roaduser, and/or a simulated moving and/or fixed obstacle. Thus, as shownwith support from FIG. 4 and further from FIGS. 1, 2, 3 and 5, thevirtual representation 9 of the simulated object feature is overlaid thereal-world video stream 6 to be temporally and spatially commensuratewith the video stream 6 such that said video stream 6 appears as abackground overlaid with—in addition to the virtual design featurerepresentation 7—said virtual functionality feature representation 9.Accordingly, upon in real-time superimposing a virtual representation 9of a simulated object feature—such as for instance a virtual pedestrianappearing to cross the road in front of the road-driven vehicle 2—on thesurrounding-showing video stream 6, said simulated object feature and/oran effect it has on the HMD-wearing occupant 3—who for instance may bethe driver of the road-driven vehicle 2—may be evaluated, e.g. whilesaid road-driven vehicle 2 is driven in real traffic and/or along actualroads. Consequently, the simulated object feature—and/or an effect ithas on the HMD-wearing occupant 3—may be evaluated in real trafficand/or in real road-driving scenarios, which thus enables said simulatedobject feature and/or the effect it has on the HMD-wearing occupant 3 tobe evaluated under more reality-resembling conditions and/or in a morereality-resembling environment than should said evaluation be performedin e.g. a commonly known static or dynamic rig displaying theenvironment and traffic on large scale screens in front of a vehiclemock-up.

Action 1007

In optional Action 1007, the vehicle feature evaluation system 1 mayupdate—e.g. by means of the user interaction updating unit 107—thevirtual functionality feature representation 8 based on a userinteraction with the simulated vehicle functionality feature. Thereby,interaction by a user with the simulated vehicle functionality featuremay result in that the virtual representation 8 of the simulated vehiclefunctionality feature is updated in accordance with said interaction.Thus, as shown with support from at least FIGS. 1, 2, 3 and 5, userinteraction with the simulated vehicle functionality feature—e.g.represented by selectable options available on the exemplifyingsimulated vehicle display—may result in that a user selected option iscarried out and/or updated in accordance with the user interaction,which subsequently is reflected by the corresponding virtual feature8—here the virtual infotainment display 8—being updated in accordancetherewith. Optionally, said user interaction may be based on detection,by means of one or more user interaction sensors, of a user in and/or atthe fictive functionality feature location 80. Thus, as shown withsupport from at least FIGS. 1, 2, 3 and 5, presence of a user, e.g. theHMD-wearing occupant 3, and/or e.g. a finger of said user/occupant 3,may be sensed in or at the position in the vehicle 2 representing thelocation of the simulated vehicle functionality feature, in FIGS. 1-3 inor at essentially the centre of the vehicle dashboard of the road-drivenvehicle 2 and/or the virtual dashboard 7, whereby the virtualrepresentation 8 of the simulated vehicle functionality feature, herethe simulated infotainment display, subsequently may be updated inaccordance with said presence, and/or in accordance with thegeographical position and/or the nature of said presence. Userinteraction may be detected in any arbitrary manner known in the art,e.g. by means of one or more user interaction sensors and/or the userinteraction determining system 1070 shown in FIG. 5, for instancecomprising touch sensor(s), camera(s) and/or position detectionsensor(s) worn by the user e.g. on his/her hand and/or finger.

Action 1008

In optional Action 1008, the vehicle feature evaluation system 1 mayupdate—e.g. by means of the vehicle signal updating unit 1008—thevirtual functionality feature representation 8′ based on a vehiclesignal affecting the simulated vehicle functionality feature, derivedfrom the road-driven vehicle 2. Thus, as shown with support from atleast FIGS. 1, 2, 3 and 5, deriving a vehicle signal which affects thesimulated vehicle functionality feature—e.g. resulting from manoeuvringof the road-driven vehicle 2—may result in that the virtualrepresentation 8′ of the simulated vehicle functionality feature, inFIGS. 1 and 3 the virtual information display 8′, is updated inaccordance therewith. That is, deriving—from the road-driven vehicle 2—avehicle signal affecting the simulated vehicle functionality feature,where the vehicle signal for instance comprises vehicle data such ase.g. fuel consumption and where the simulated vehicle display shows saidvehicle data e.g. fuel consumption, may result in that the virtualfeature 8′—in FIGS. 1 and 3 the exemplifying virtual information display8′—is updated in accordance with said vehicle signal, i.e. the fuelconsumption value shown on the virtual information display 8′ is updatedalong with the received updated fuel consumption value. The vehiclesignal may be derived from the road-driven vehicle 2 in any arbitraryknown manner, for instance via wired and/or wireless communicationtherewith, and/or with support from the vehicle signal determiningsystem and/or unit 1080 adapted for determining which input derived fromthe road-driven vehicle 2 affects the simulated vehicle functionalityfeature.

Action 1009

In optional Action 1009, the vehicle feature evaluation system 1 mayupdate—e.g. by means of the continuous updating unit 109—the real-timesurrounding-showing video stream 6, the superimposed virtual designfeature representation 7, the superimposed virtual functionality featurerepresentation 8 and/or the superimposed virtual object featurerepresentation 9 based on updated captured image data 211 and/or basedon updated determined HMD orientation. Thus, as shown with support fromat least FIGS. 1-5, it is provided that the real-time video stream 6and/or the virtual representation(s) 7, 8, 9 are continuously updated toreflect updated captured image data 211 and/or updated orientation ofthe HMD.

The person skilled in the art realizes that the present disclosure by nomeans is limited to the preferred embodiments described above. On thecontrary, many modifications and variations are possible within thescope of the appended claims. It should furthermore be noted that thedrawings not necessarily are to scale and the dimensions of certainfeatures may have been exaggerated for the sake of clarity. Emphasis isinstead placed upon illustrating the principle of the embodimentsherein. Additionally, in the claims, the word “comprising” does notexclude other elements or steps, and the indefinite article “a” or “an”does not exclude a plurality.

1. A method performed by a vehicle feature evaluation system for enabling evaluation of a simulated vehicle-related feature, the method comprising: determining in relation to a road-driven vehicle, with support from a tracking system, an orientation of a head mounted display, HMD, adapted to be worn by an occupant on-board the road-driven vehicle; determining a simulated vehicle design feature to be evaluated in the road-driven vehicle; providing in real-time to a HMD display of the HMD, taking into consideration the HMD orientation, a virtual representation of the simulated vehicle design feature superimposed on a real-time surrounding-showing video stream derived from real-world image data captured with support from one or more vehicle-attached cameras adapted to capture surroundings external of the road-driven vehicle.
 2. The method according to claim 1, wherein the simulated vehicle design feature comprises a simulated vehicle interior section and/or a simulated vehicle exterior section.
 3. The method according to claim 1, further comprising: determining a simulated vehicle functionality feature to be evaluated in the road-driven vehicle; wherein the providing further comprises additionally providing in real-time to the HMD display, taking into consideration the HMD orientation, a virtual representation of the simulated vehicle functionality feature superimposed on the real-time surrounding-showing video stream, which simulated vehicle functionality feature for instance comprises: a simulated vehicle human machine interface, HMI; a simulated vehicle display; a simulated vehicle head-up display, HUD; simulated light characteristics; and/or a simulated effect resulting from a simulation of the simulated vehicle functionality feature.
 4. The method according to claim 1, further comprising: determining a simulated object feature to be evaluated in the road-driven vehicle; wherein the providing further comprises additionally providing in real-time to the HMD display, taking into consideration the HMD orientation, a virtual representation of the simulated object feature superimposed on the real-time surrounding-showing video stream, which simulated object feature for instance comprises: a simulated other vehicle; a simulated road user; and/or a simulated moving or fixed obstacle.
 5. The method according to claim 1, further comprising: determining: a fictive design feature location of the simulated vehicle design feature relative the road-driven vehicle; a fictive functionality feature location of the simulated vehicle functionality feature relative the road-driven vehicle; and/or a fictive object feature location of the simulated object feature relative the road-driven vehicle; wherein the providing taking into consideration the HMD orientation comprises: providing the virtual design feature representation superimposed on the real-time surrounding-showing video stream such that positioning of the virtual design feature representation corresponds to the fictive design feature location; providing the virtual functionality feature representation superimposed on the real-time surrounding-showing video stream such that positioning of the virtual functionality feature representation corresponds to the fictive functionality feature location; and/or providing the virtual object feature representation superimposed on the real-time surrounding-showing video stream such that positioning of the virtual object feature representation corresponds to the fictive object feature location.
 6. The method according to claim 4, further comprising: updating the virtual functionality feature representation based on a user interaction with the simulated vehicle functionality feature, which user interaction for instance is based on detection, by means of one or more user interaction sensors, of a user in and/or at the fictive functionality feature location; and/or updating the virtual functionality feature representation based on a vehicle signal affecting the simulated vehicle functionality feature, derived from the road-driven vehicle.
 7. The method according to claim 1, further comprising: updating: the real-time surrounding-showing video stream; the superimposed virtual design feature representation; the superimposed virtual functionality feature representation; and/or the superimposed virtual object feature representation based on updated captured image data and/or based on updated determined HMD orientation.
 8. A vehicle feature evaluation system for enabling evaluation of a simulated vehicle-related feature, the vehicle feature evaluation system comprising: a HMD orientation determining unit for determining in relation to a road-driven vehicle, with support from a tracking system, an orientation of a head mounted display, HMD, adapted to be worn by an occupant on-board the road-driven vehicle; a design feature determining unit for determining a simulated vehicle design feature to be evaluated in the road-driven vehicle; a HMD providing unit for providing in real-time to a HMD display of the HMD, taking into consideration the HMD orientation, a virtual representation of the simulated vehicle design feature superimposed on a real-time surrounding-showing video stream derived from real-world image data captured with support from one or more vehicle-attached cameras adapted to capture surroundings external of the road-driven vehicle.
 9. The vehicle feature evaluation system according to claim 8, wherein the simulated vehicle design feature comprises a simulated vehicle interior section and/or a simulated vehicle exterior section.
 10. The vehicle feature evaluation system according to claim 8, further comprising: a functionality feature determining unit for determining a simulated vehicle functionality feature to be evaluated in the road-driven vehicle; wherein the HMD providing unit is adapted for additionally providing in real-time to the HMD display, taking into consideration the HMD orientation, a virtual representation of the simulated vehicle functionality feature superimposed on the real-time surrounding-showing video stream, which simulated vehicle functionality feature for instance comprises: a simulated vehicle human machine interface, HMI; a simulated vehicle display; a simulated vehicle head-up display, HUD; simulated light characteristics; and/or a simulated effect resulting from a simulation of the simulated vehicle functionality feature.
 11. The vehicle feature evaluation system according to claim 8, further comprising: an object feature determining unit for determining a simulated object feature to be evaluated in the road-driven vehicle; wherein the HMD providing unit is adapted for additionally providing in real-time to the HMD display, taking into consideration the HMD orientation, a virtual representation of the simulated object feature superimposed on the real-time surrounding-showing video stream, which simulated object feature for instance comprises: a simulated other vehicle; a simulated road user; and/or a simulated moving or fixed obstacle.
 12. The vehicle feature evaluation system according to claim 8, further comprising: a location determining unit for determining: a fictive design feature location of the simulated vehicle design feature relative the road-driven vehicle; a fictive functionality feature location of the simulated vehicle functionality feature relative the road-driven vehicle; and/or a fictive object feature location of the simulated object feature relative the road-driven vehicle; wherein the HMD providing unit further is adapted for: providing the virtual design feature representation superimposed on the real-time surrounding-showing video stream such that positioning of the virtual design feature representation corresponds to the fictive design feature location; providing the virtual functionality feature representation superimposed on the real-time surrounding-showing video stream such that positioning of the virtual functionality feature representation corresponds to the fictive functionality feature location; and/or providing the virtual object feature representation superimposed on the real-time surrounding-showing video stream such that positioning of the virtual object feature representation corresponds to the fictive object feature location.
 13. The vehicle feature evaluation system according to claim 11, further comprising: a user interaction updating unit for updating the virtual functionality feature representation based on a user interaction with the simulated vehicle functionality feature, which user interaction for instance is based on detection, by means of one or more user interaction sensors, of a user in and/or at the fictive functionality feature location; and/or a vehicle signal updating unit for updating the virtual functionality feature representation based on a vehicle signal affecting the simulated vehicle functionality feature, derived from the road-driven vehicle.
 14. The vehicle feature evaluation system according to claim 8, further comprising: a continuous updating unit for updating: the real-time surrounding-showing video stream; the superimposed virtual design feature representation; the superimposed virtual functionality feature representation; and/or the superimposed virtual object feature representation based on updated captured image data and/or based on updated determined HMD orientation.
 15. A vehicle comprising a vehicle feature evaluation system according to claim
 8. 